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ABSTRACT 

A study began the development and initial testing of 
a method for predicting cost and training effectiveness of proposed 
training programs. A prototype Training Effectiveness and Cost 
Effectiveness Prediction (TECEP) model was developed and tested. The 
model was a method for optimization of training media allocation on 
the basis of fixed training effectiveness and minimum cost. To test 
its feasibility, this model was applied to the TA-U aircraft training 
system. A training analysis of the TA*4 training program was 
conducted to determine possible media substitutions. In conjunction 
with A-U pilots, a mix of training media was sel'sjcted for each task 
from possible media alternatives, such as classrooin, cockpit 
procedures training, aircraft plus instructor, and actual carrier 
landing. Substitutions which the computer would be permitted to make 
among the various media were determined. Cost factors were developed 
for the TA-U aircraft and training media. A comparison of costs 
between the existing system and the system developed chosen by the 
linear system showed the model was feasible and saved money. Further 
development and refinement of the model are discussed. (Author/JK) 
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ABSTRACT 

Staff Study on Cost and Training 
Effectiveness of Proposed Training Systems 

This report describes the activities performed during a Staff Study 
on the cost and training effectiveness of proposed training systems. 

Development of a Training Effectiveness and Cost Effectiveness 
Prediction (TECEP) Model was begun. It will eventually contain the 
following elements: task description and analysis; characteristics 
of student population; training tasks and training stages; a method 
for the determination of useful media options; media cost factors; 
guidelines for substitution and transfer; training program of primary 
media and allowable substitutions; linear program to optimize for least 
cost; and a report including economic analysis and recommendations. 

An application of the TECEP Model using the TA-4 advanced jet 
training system was performed to test the feasibility of the Model. 
Included in the discussion of the application are a training analysis, 
training media mix options, cost factors for the TA-4 aircraft and 
training media, and TA-4 training system cost/training effectiveness. 
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FOREWORD 

This report (and a separately published supplement entitled. Analysis 
of the Transfer of Training, Substitution and Fidelity of Simulation of 
Training Equipment, TAEG Report 2) documents the results of a four- 
month staff study undertaken by a four-man team of the Naval Training 
Equipment Center's Training Analysis and Evaluation Group (TAEG). The 
goal of this study is to develop a procedure for evaluating alternate 
training systems and for selecting from among them the most cost 
effective one. 

This procedure can be used to look at existing training systems, as 
well as at projected training programs where significant roles are planned 
for training media and devices. The reader is encouraged to "try out" 
the system on his own problems to determine its workability and usefulness 
in making resource allocation decisions. Computer programs for the 
computation of media cost factors and optimizing for least cost can be 
obtained from the Naval Training Equipment Center, Orlando, Florida 32813 
(TAEG/Code 10). Feedback from such efforts directed to this address 
will be quite useful in improving the system since continuing development 
by TAEG is planned if initial "try outs" warrant it. 

This study was conducted by a team of engineering, psychological, 
educational, and operations research personnel. They are: Dr. R. Braby, 
Dr. G. S. Micheli, C. L. Morris, Jr., and H, C. Okraski, P.E. 



SUMMARY 

STAFF STUDY ON COST AND TRAINING EFFECTIVENESS 

OF 

PROPOSED TRAINING SYSTEMS 

The objectives of the Staff Study were to: (1) begin development 
and initiate testing the feasibility of a method for predicting cost and 
training effectiveness of proposed training programs; and (2) prepare a 
paper on the training effectiveness of simulators. The results of the 
first are contained in this report; the second is separately bound. 

A prototype Training Effectiveness and Cost Effectiveness Prediction 
(TECEP) Model was developed and tested. It is a method for optimization 
of training media allocation on the basis of fixed training effectiveness 
and minimum cost. The overall Model consists of three sub-models, each 
of which could function independently if so desired by a user. They 
are media substitution and selection, life cycle cost, and optimization. 

Elements of the TECEP Model and their interactions are shown in 
Figure 1. The purpose of each element is briefly noted below. 

1. Task Description and Analysis . Identify the tasks involved in 
the system being studied and obtain information about those tasks 
required for the training analysis. 

2. Personnel Characteristics . Describe the skills required of 
personnel to be assigned to the operational system and the character- 
istics (including entry skills) of the student population. 



ii 



i 



0^ 

i 3. TralnlnR Tasks and Training Stages , The tasks are grouped into 

^ a series of stages in order to develop a curriculum for the training 

system. Types of learning tasks encountered in each stage are classified 
according to a task taxonomy. 

4. Determination of Useful Media Options . A matrix was developed 
to assist in the selection of a training media mix. The matrix consists 
of a list of tasks grouped into learning blocks, learning guidelines 
associated with each task category, a set of implications for media 
selection associated with each learning guideline, and a list of training 
media. 

5. Media Cost Factors . Nineteen factors are used in calculating 
life-cycle costs and to generate cost per utilization hour at various 
use rates. 

6. Guidelines on Substitution and Transfer . To assist with the 
following element, which involves determining the media which can 

I substitute for other media, guidelines in the form of media substitution 

options are derived from transfer and substitution data available from 

'I 

^' the training effectiveness literature, or, when data are not available. 
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p from estimates of the percentage substitution for the tasks involved. 

7. Primary Media and Allowable Substitutions . The primary and 
1^ alternative mixes of media, which are all considered capable of producing 

personnel equally trained to a specified level of proficiency, are 
recorded for each stage. The number of hours of all acceptable 
f*' alternatives are recorded. 



r 



ill 



The feasibility of the TECEP Model has been demonstrated. Tt is 
believed that the method used would result In considerable savings to 
the Navy If applied during the conceptual stages of training system 
development* Where -and how the Model can be further developed and 
refined Is discussed. 
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SECTION I 



OBJECTIVES OF THE STAFF STUDY 

The Naval Training Equipment Center (NAVTRAEQUIPCEN) has been 
actively conducting independent programs on measuring cost effectiveness 
and training effectiveness of training devices. Building upon this 
background, the staff study team focused its attention on two aspects 
of training system design that have not previously been emphasized. 
They are (1) integration of cost effectiveness and training effective- 
ness measurement, and (2) prediction of the cost and effectiveness of 
proposed training systems. 

A Training Effectiveness and Cost Effectiveness Prediction (TECEP) 
Model was developed and tested. It is a method for optimization of 
training media allocation on the basis of fixed training effectiveness 
and minimum cost. The overall Model consists of three sub-models. 
They are media substitution and selection, life cycle cost, and 
optimization. The Model will be further tested by applying it to 
training analyses performed by TAEG teams. 

This report describes the activities performed to accomplish the 
objectives of the staff study, specifically, to test the feasibility of 
a generalized method for predicting cost and training effectiveness. 
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SECTION II 



TECHNICAL APPROACH 

A. INTRODUCTION 

The Training Ef f ectivenesi? and Cost Effectiveness Prediction (TECEP) 
Model depicts the process of translating task descriptions and learning 
principles into prescriptions for the design of training systems. The 
output of the Model is to be a basic description of a proposed training 
sj'snem thought to be (1) powerful enough to accomplish the training tasks 
with the assigned student population, and (2) incorporating the lowest 
cost mix of media capable of achieving that goal. 

The act of prescribing or proposing the characteristics of a training 
system is a complex decision-making task with numerous unspecified and 
unknown alternatives. The design of these systems is both a science and 
an art; a science to the extent that the scientific method, including 
the use of theory, is employed, and an art to the extent that a subjective 
feel for training or individual expertise is relied upon. 

The TECEP Model described in this report is an attempt to focus 
learning theory, economic analysis and other evidence acquired through 
the use of the scientific method on the task of training system design. 
The Model is also intended to sensitize the skilled educator to perceive 
the possible outcomes of alternative training approaches. Both the 
scientific and the artistic approaches are imperative and must be melded 
together to achieve a functioning design. 

2 
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B. TECEP MODEL 

The TECEP Model is presented as Figure 1. A description of each 
element in the Model is presented below. Those e x ,\ts within the 
Model that were developed within this study will ie&cribed in greater • 
detail than these that were adapted from other sources. 

Task Description and Analysis . Numerous task analysis methods have 
been devised, any one of which could probably be applied. However, the 
Naval Training Equipment Center has supported a program of research 
concerned with the development of task analysis techniques specifically 
for use in the development and use of training equipment. One such task 
analysis method is described in Chenzoff, A. P. and Folley, J.D., Guidelines 
for Training Analysis (TSA) , NAVTRADEVCEN Technical Report 1218-4, 1965, 
(AD 472155). Within these task analysis methods, each task to be performed 
by man within the operational system is described. The description should 
include an inventory of skills and knowledges that operators, sub-teams, 
teams, and multi-team forces must possess in order to carry out those 
functions assigned to man within a man-machine system. Where possible, 
the tasks should be described as specific behavioral objectives, i.e., 
what should be done, under what conditions, and how well. 

2* Personnel Characteristics . The characteristics of personnel to 
be assigned to the operational system, and to a related training program, 
must be defined along with an estimate of the pertinent knowledges and 
skills they will have prior to system training. The number of students 
to be selected for training should be stated. 
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3. Training Tasks and Training Stages , A preliminary curriculum 
outline should be developed for the training system, grouping the tasks 
Into natural groups and sequences of groups. At this stage, the 
curriculum outline should consist of a series of phases or sLages in a 
training program. A stage should contain fundamentally similar tasks. 
The stages should be ordered so prerequisite skills are acquired before 
advanced skills are attempted. Individual tracks will be required for 
each position in a tactical team. These tracks will converge into a 
single track as the stages of training move from operator part-tasks 
and operator tasks to sub-team, team, and mul£i-team stages. The 
general characteristics of tasks to be accomplished in each stage 
should be categorized in terms of task/behavior categories listed in 
Table 1. Most stages in a training program, and specific tasks within 
a stage, will be described as complex tasks involving two or more task 
categories. As an example. Table 2 depicts one of eleven stages in the 
( TA-4J Advanced Jet Syllabus in the Navy Undergraduate Pilot Training 

Program. Primary task categories for each task and for the stage are 
presented. 

4. Determination of Useful Media Options . Media options or 
alternatives are identified, without regard to cost, through the use of 
( the media selection matrix. The matrix was developed to aid the training 

system designer in identifying a cluster of training media suited to the 
characteristics of specific training tasks. It provides a means for 
ranking media in order of pedagogical power to deal with specified 
training tasks. It should be noted that final media selection is based 
^ not only on the pedagogical power of the media to achieve training 
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Table 1 



TASK CATEGORIES 

1. Recalling Facts and Principles 

2. Recalling Procedures 

3. Non-Verbal Identification 

4. Non-Verbal Detection 

5. Using Principles, Interpreting, Inferring 

6. Making Decisions 

7. Continuous Movement 

8. Verbal Detection and Identification 

9. Positioning and Serial Movement 

10. Repetitive Movement 

11. Written Verbalization 

12. Oral Verbalization 

13. Other Verbalization, including Signs 



Task categories are based on the 19 categories identified in M, Paul 
Willis and Richard 0. Peterson, Deriving Training Device Implications from 
Learning Theory Principles . Technical Report: NAVTRADEVCEN 784-2, 1961. 

Tasks categories are listed in order of their priority in Naval Tasks 
as reported in B. R. Bernstein and B. K. Gonzales, Learning, Retention 
and Transfer . Technical Report: NAVTRADEVCEN 68-C-0215-1, 1971. 

See Appendix A for descriptions of these task categories. 
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Table 2 



Categorization of Tasks in the Familiarization Stage in the 
TA-4J Advanced Jet Navy Undergraduate Pilot Training Program. 



Stage 


Tasks Within Stage 


Primary Task Categories 


Familiarization 


Cockpit Procedures 


Recalling Procedures 
Non-Verbal Identification 
Positioning & Serial Movement 




Pretlight Inspection 


Recalling Procedures 
Non-Verbal Identification 
Making Decisions 




Normal Operating 
Procedures 


Recalling Procedures 
Non-Verbal Identification 
Continuous Movement 
Positioning and Serial Movement 




Nosewheel Steering and 
Taxi Procedures 


Recalling Procedures 
Non-Verbal Identification 
Continuous Movement 
Oral Verbalization 




Take-off /Climb /Level 
Off 


Recalling Procedures 
Non-Verbal Identification 
Continuous Movement 
Positioning and Serial Movement 
Oral Verbalization 




Aerobatics 


Recalling Procedures 
Non-Verbal- Identification 
Continuous Movement 




Landing 


Recalling Procedures 
Non-Verbal Identification 
Continuous Movement 
Positioning and Serial Movement 
Oral Verbalization 
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objectives, but also on the broader view of an economic trade-off 
analysis of the usv?. of alternate media, as described In later steps. 

Media selection is accomplished by identifying media that 
facilitate or make possible the use of specific learning guidelines based 
on learning theory. Further, the matrix is based on the assumption that 
the greater the number of learning guidelines that can be facilitated 
by a medium, the greater the productivity of that medium to accomplish 
a training task in that specific task category* 

One page of the matrix is presented as Table 3, and the entire 
19-page matrix is located in Appendix A. The first column of the Media 
Selection Matrix, entitled Task Categories, contains descriptions of the 
common behavioral attributes and examples of each of the thirteen task 
categories incorporated into the matrix. The next column. Task Elements, 
divides each task category into elements so that learning guidelines 
can be associated with standard elements of a task, e.g. , learning 
guidelines associated with the stimulus aspect of a task. The column. 
Learning Guidelines, contains rules-of-thumb , based on learning theory, 
for designing and using a learning system for a specific type task. A 
total of 105 Learning Guidelines are identified and associated with the 
thirteen task categories. 

, In the next column. Implications for Media Selection, one or 
more implications are associated with each "Learning Guideline." They 
serve to simplify the task of determining if a specific medium facili- 
tates the use of the learning guideline. 
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Twenty media options are listed on the matrix. This represents 
a wide, but not exhaustive, set of options. Table 4 further identifies 
these media. In an effort to keep the size of this report to a minimum, 
these media options are not further defined. For a detailed description 
of many of these media, the reader is referred to Rhode, et al. Analysis 
and Approach to the Development of an Advanced Multimedia Instructional 
System , Technical Report AFHRL-TR-69-30, Vols, 1 and 2, Westinghouse 
Learning Corporation^ 1970. 

Additional media options can be added to the matrix, as required. 

An "F" appears at the intersection of the column for a specific 
medium and the row containing an implication for media selection if the 
medium automatically facilitated the application of the guideline. An 
"M" appears in the matrix if t)ie implication for media selection and its 
related learning guideline can be carried out manually by the instructor 
within the context of the medium. 

The matrix aids the training system designer in determining which 
media will allow him to apply a significant number of learning guidelines 
for a specific training task. 

5. Media Cost Factors . The process of developing media costs by way 
of life cycle cost analysis is outlined in Figure 2 and includes: (a) the 
identification of cost elements and the categorization of these elements 
into cost factors; (b) the estimation of cost factor values, and (c) the 
use of the cost factor values in calculating cost per utilization hour 
for each medium. The Model was programmed for the digital computer in 
FORTRAN and run on the XDS Sigma 7 computer. 
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Table U 





MEDIA IN MEDIA SELECTION MATRIX 


CCTV 


Closed Circuit Television Without Feedback 


pKl) 


Linear Programmed Instruction Text * 


PI(B) 


Programmed Instruction Text With Branching 


SRS(T/S) 


Student Response System, Feedback to Teacbor and Students 


SRS (AV) 


Student Response System with Audio-Visual Program 


PIA 


Portable Instructor Aids (projectors and recordings) 


CM (MM) 


Computer Assisted Instruction with Mixed Media 


LCD(AV) 


Learner-Centered AV Devices - Carrel 


VTR 


Portable Video Tape Recorder System 


LECT/TEXT 


Conventional Classroom: instructor, lecture and 




textbook 


PA 


Performance Aids 


Carrel/Mock-Up 


Audio-Visual Carrel with Equipment Mock-Up 


SIM 


Simulator 


SIM/AA 


Simulator with Automatic and Adaptive Features 


PROC TNR 


Computer Activated Procedure Trainer 


PROC TNR/AA 


Computer Activated Procedure Trainer with Automatic 




and Adaptive Features 


Manual PROC TNR 


Manual Procedure Trainer 


C/Gaming 


Computer Gaming Trainer 


OP/SYS 


Operational System 


OP/SYS & SIM 


Operational System Plus Simulation 
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Figure 2. Training Media Life Cycle Cost Model 
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Alternative training systems are compared on the basis of 
training media cost per utilization hour. Total life cycle costs are 
used in the comparison, and all costs, non-recurring and recurring, are 
transformed to an Equivalent Uniform Annual Cost (EUAC) for each training 
medium* The EUAC is a cost that represents the annual equivalent of a 
non-uniform distribution of actual costs. This parameter facilitates 
the comparison of costs where money has a time value and the disbursements 
are non-unifonnly distributed. The EUAC can be viewed as a series of equal 
annual payments occurring at the end of each year throughout the life cycle 
of the training medium. 

The application of the Capital Recovery Factor requires an 
approximation of the economic life of the training medium. The economic 
life is that period of time over which the benefits to be gained from 
the training medium may reasonably be expected to accrue to the Department 
of Defense. The economic life of training aquipment begins in the year 
in which the equipment is first utilized for training and ends in the 
last year of utilization. The analysis assumes zero salvage value for 
training equipment at the end of its economic life. The Capital Recovery 
Factor also necessitates the assumption of an interest rate. Interest 
is treated as a cost to all Government expenditures. This position is 
based on the premise that no public investment should be undertaken 
without considering the alternative use of the funds which it absorbs 
or replaces. As a consequence, this analysis includes a ten percent 
discount rate in the life cycle cost model. 

Once the Equivalent Uniform Annual Cost (EUAC) for each medium 
Is determined, the cost per utilization hour is computed by dividing the 

13 
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EUAC by the annual utilization rate of the medium. The resultant cost 
rate is the figure of merit used for comparison purposes. The cost 
rates are displayed on the computer printout as functions of various 
utilization rates. 

As a requisite to using the life cycle cost model, it is n^nossary 
to identify the cost elements and factors associated with training media. 
Table 5 lists the majority of the cost elements considered in viewing 
training device life cycle costs. Operational equipment used for 
training purposes have published cost factors which encompass related 
cost elements. Following the identification of cost elements, the media 
cost elements must be grouped as necessary and the resultant grouping 
reidentified as cost factors. Figures 3 and 4 identify 17 cost factors 
and show how these factors are combined in computing life cycle costs. 
Appendix B provides definitions for each of these factors. Equations 
and directions for combining these factors are also provided. Table 6 
is a computer generated listing of cost factors for each of 17 media. 
Column headings are defined in Table 5. These cost factors were an input 
to a linear program to optimize for least cost in the media mix study 
reported in Section III of this report. 

6. Guidelines on Substitution and Transfer > Transfer of training 
studies have demonstrated that traiinng devices can be used effectively 
to reduce time spent in training in operational situations, with associated 
cost savings. Therefore, as a normal operating procedure, attempts should 
be made to identify training areas in which proficiency can be achieved 
at lower overall cost through increased emphasis on the use of training 
devices . 
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Substitution and transfer can only be considerea in terms of 
specific behaviors. An initial and basic effort in a training situation 
analysis, therefore, should be to identify each of the behaviors to be 
developed. The definition of training (or behavioral) objectives is 
critical. A training objective will identify: (1) specific knowledges, 
skills, and attitudes required of the trainee following completion of 
training, and (2) the knowledge and performance criteria used in 
measuring the trainee's level of achievement within specific behavioral 
objectives. In addition, behavioral objectives can be used to define 
the psychological processes involved in their attainment. Including 
media alternatives, substitution of one medium for another and the transfer 
from one training situation to another. It is important that attention 
be given in the analysis of training objectives, to identifying those which 
relate not only to essential knowledges and skills, but to attitudes and 
motivations as well. 

The TECEP Model involves media substitution options. With the 
aid of digital computer techniques, a determination can be made concerning 
which media can be substituted for other media. Using transfer and 
substitution data that could be applied from related tasks as guidelines 
for the limits and ratios of substitution, media substitution options 
have been estimated for certain projects. The technical report prepared 
as part of this study, but published separately, gives the data available 
from the training effectiveness literature from which estimates of the 
amount of simulator training time that can be substituted for operational 
system training time can be deriN^ed. When the data are not av^iilable 
or are of limited applicability, it will be necessary to estimate the 
percentage substitutions for the tasks involved. 
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7. Primary Media and Allowable Substitutions * The media 
Substitution Optior Form, Figure 5, is used to record the primary and 
alternative media selections for each stage in the proposed training 
program* Separate forms are used for each task* The primary and all 
alternative mixes of media are considered capable of achieving criterion 
performance* 

Under the heading "Recommended Hours" per medium, the initial 
selection of media, and the hours per medium per student are recorded* 
Under the heading "Minimum Hours" per medium is recorded the hours in 
that medium that cannot be traded away* Under the heading "Difference" 
is recorded the number of hours that can be traded* In the remaining 
cell.;} in the row, all acceptable trade-offs are recorded by inserting 
the number of hours in the alternate media that can be substituted for 
the "Difference" hours in the primary medium* 

8* Optimize for Least Cost * In the process of defining training 
system alternatives, it is necessary to evaluate many mixes of training 
media* In most cases, various media combinations are equally effective 
for each stage of training and the problems of evaluating substitution 
ratios and life cycle costs become very complex* If 15 to 20 training 
media have possible application in any of 50 tasks and if the hourly 
cost of each medium varies inversely with utilization, a linear program 
for evaluating alternatives becomes a desirable analytic tool* 

The linear program*'- adapted for use in this application is one 
in which the analyst can use up to 75 constraint equations and 75 variables* 

Hlr* Paul R* Little of the TAEG Staff adapted the program for use with 
the TECEP Model* 
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The program uses the simplex method of solution and provides the minimum 
or maximum objective function, as well as slack and sensitivity. A 
sample computer printout of a linear programming problem used for TA-4J 
training system media selection and a brief description of the tabulated 
results are shown In Appendix A. 

An economic analysis of a training system can only be as good 
as the confidence level associated with media substitution ratios and 
life cycle cost estimates. If It Is assumed that the approach to the 
development of this Information results In high confidence estimates, 
the only remaining problem is one of optimizing media mix In order to 
achieve lowest cost. The linear program described accomplishes this 
very effectively and the variable slack and sensitivity Information 
provided enables the analyst to assess costs associated with system 
variations. 

One limitation of the linear programming cost optimization 
approach Is the necessity for multiple computer runs. Media cost 
varies Inversely with utilization rate and the final utilization rate 
cannot be determined before linear program media selection is accomplished. 
Consequently, an Iterative approach to final solution is necessary and 
media cost per utilization hour is recomputed between each linear program 
iteration. Considering the manual operations required between iterations, 
it would appear that manpower and computer time requirements would 
become prohibitive. This is not the case, however, because cost per 
utilization hour is computed in 5% increments, and substitute media cost 
differences are generally significant. As a result, the solution will 
seldom require more than five iterations. In addition, a linkage 
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program is presently being considered which will eliminate manual 
operations between iterations. When this is accomplished, the only 
additional time required will be computer time. As an example, four 
Iterations will Increase computer time by a factor of four. However, total 
time will be measured In seconds and will not affect computer cost 
significantly. 

9. Report on Economic Analysis and Recommendations . The TECEP Model 
provides basic cost factors required in the economic analysis of alternative 
proposed training systems. Additional information, outside the scope of 
the Model, will usually be required. 

Economic Analysis, as its name implies, is an analytic study 
of the economic factors associated with a proposed course of action. 
Accordingly, It Includes all of the analytic techniques embodied in cost- 
effectiveness and cost-benefit analysis. In addition, it Includes classi- 
cal economic theory and financial analysis methodology. It can be thought 
of as a discipline which encompasses all economic analytic techniques and 
as such, it is considered to be the best method available for estimating 
resource requirements associated with proposed training systems. 

In order to establish a particular economic analysis methodology 
for training systems which will provide usable, high confidence results, 
it Is first necessary to determine a value base for training which will 
allow for estimates of training systems worth. This becomes an 
Impossible task if value is to be measured in dollars only because 
value Is based on benefit gained which is often a subjective quantity. 
When a free market system operates, as In the private sector of the 
economy, value is equated to a dollar amount which buyers exchange for 
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value received. Since this mechanism does not allow for value 
determination of training systems used within the Department of the 
Navy, other methods must be employed. 

As an example. It can be stated that the value of a training 
system Is proportional to the number of trained men out per unit time 
(assuming a fixed entry level and minimum acceptable output level). 
If this definition Is accepted, system benefit can be Increased by In- 
creasing the number of men out per unit time or by maintaining a 
constant number out while Increasing the minimum acceptable standard 
of the output. In either case, only relative values can be estimated 
and the relative ranking Is based on Identifiable and quantifiable 
attributes. The decision maker must recognize these limitations, and 
In many cases, must modify value factors based upon his broader 
knowledge base of strategic, political, and social considerations. 
For this reason, an economic analysis should be designed to provide 
the decision maker with the type of Information needed to asses^s costs 
and benefits of alternative courses of action. This will allow him to 
Increase his confidence level of risk and payoff assessment. 

As stated In SECNAVINST 7000.14, "Economic Analysis of Proposed 
Department of the Navy Investments", "...the objectives of an Economic 
Analysis should be to assist In providing a basis to recommend and 
select a plan of action. It applies both to situations In which the 
alternative outputs or benefits can be quantified and to situations In 
which the alternative outputs cannot be easily quantified. In both of 
these situations, the objective Is to Identify; 
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a. The least costly alternative of several equally 
effective ways to achieve a required objective; 

b. The alternative which is expected to produce the greatest 
benefits or effectiveness for a given cost level; 

c. The relative cost of various alternatives and the effective- 
ness that can be provided so a judgment can be made as to whether the 
increased effectiveness is wor*:h the additional cost;...." 

This study has been limited to an approach which is to select 
the least costly alternative of several equally effective ways to 
achieve a required objective. It is probably the most widely used 
economic analysis method because alternative systems need only meet a 
certain minimum criterion effectiveness level. As explained previously, 
alternative training systems were analyzed, each of which was considered 
capable of producing a trained man at a minimum acceptable skill level. 
The life cycle costs associated with each of these systems was then 
determined. The costing approach used considered the time value of money 
and included 17 cost factors. Estimated utilization was also considered 
for each alternative which allowed for the development of a life cycle 
cost per utilization hour. If the decision maker feels that alternative 
systems do» in fact, perform equally well and that the life cycle cost 
figures are reasonable, he will most likely select the lowest cost 
system. 

In most cases, this approach will suffice. However, both the 
variable effectiveness case for a given resource expenditure and the 
variable effectiveness case for a variable resource expenditure provide 
more realistic approaches to many investment decisions. 
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It is in this area of training system effectivensss value 
measurement that a fertile field exists for further research and 
model development. When the strategist can use a high confidence 
model to assess the value of training as it applies to weapon systems 
effectiveness, he will be ahle to more efficiently allocate available 
resources. Based upon the Judgment of researchers within NAVTRAEQUIPCEN, 
model development in this area will provide a tool for training system 
value assessment which Is not currently available. Consequently, the 
application of a model such as this should result in significant 
savings to the Navy. 
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SECTION III 



APPLICATION OF TECEP MODEL TO TA-4 AIRCRAFT TRAINING SYSTEM 

A. INTRODUCTION 

The TECEP Model was applied to the TA-4 training system in order 
to assess the practicality of the proposed analysis approach. The TA-4 
training system was selected for a number of reasons. The Undergraduate 
Pilot Training Program has been studied by North American/Link; the 
TA-4J Operational Flight Trainer has been developed and is currently 
being used; transfer and substitution studies are being conducted; and 
cost factor support data are available. Building on this foundation, 
an attempt has been made to use learning principles, instructional 
media option knowledge, substitution guidelines, and cost optimization 
techniques to describe a system which would provide increased training 
efficiency at a reduced cost. The application of the Model was performed 
prior to the completion of the Media Selection Matrix. Therefore, in 
this application, media were selected without the aid of this matrix. 

B. TRAINING ANALYSIS 

A training analysis of the system was conducted to determine, in 
conjunction with A-4 pilots, possible media substitutions. 

Task descriptions produced by North American/Link for the Navy 
Undergraduate Pilot Training Study and the TA-4J Advanced Jet Syllabus 
used at Naval Air Station, Kingsville, weve analyzed in order to derive 
a list of tasks which describe the behaviors the trainees must learn 
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and for which meaningful blocks of training can be developed. The 
list of tasks was reviewed with two A-4 pilots. Based upon comments 
made and insights gained during this discussion, a revised list of 
tasks was prepared. This list is shown in Table 7. 

The number of hours for each stage of training was obtained from 
the TA-4J Advanced Jet Syllabus, and the A-4 pilots were asked to 
apportion hours to each task of each stage. 

C. TRAINING MEDIA MIX OPTIONS 

In conjunction with the A-4 pilots, a mix of training media was 
selected for each task from possible media alternatives, namely, 
classroom, tutor, carrel, cockpit familiarization trainer, cockpit 
procedures trainer. Device 2F90, Device 2F90 with narrow-angle visual 
(Simulator "A") , Device 2F90 with wide-angle visual (Simulator "B") , 
simulated carrier; landing aircraft (non-flight), aircraft plus instructor 
aircraft solo and actual carrier landing. Finally, substitutions which 
the computer would be permitted to make among the various media were 
indicated for later translation into a computer program. Guidelines 
for the substitutions were obtained from the estimated amounts of flight 
time that can be substituted for by training devices which were 
developed by North American/Link for the Navy UPT study and Lockheed 
and Northrop for the Air Force UPT studies. Table 8 shows the North 
American/Link TA-4 flight substitution recommendations. Figure 6 
shows the media substitutions made for one of the tasks. 
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Table 7 



TA-4J PILOT TASKS 



Stage 
Familiarization 



Basic Instruments 



Instrument Navigation 



Formation 



Night Flying 



Operational Navigation 



Task 

Cockpit Procedures 

Preflight Inspection 

Normal Operating Procedures 

Nosewheel Steering and Taxi Procedures 

Takeoff 

Climb/Level Off 

Aerobatics 

Landing 

ITO 

Climb/level Off 
Aerobatics 
Penetration 
Missed Approaches 

Clearance Training 

TACAN 

ADF 

Missed Approach 
GCA 

Cross Country 

Parade & Cruise Formation Positions 

Maneuver in Formation 

Breakups and Rendezvous 

Column Format ions /Guns ight Tracking 

Combat Spread/Tactical Section 

Takeoff and Rendezvous 
Maneuvers 

NAV /with /without Radio Aids 

Formations 

Landings 

DR NAV (low level/night/day) 
Target Recognition 
Weapon Delivery Maneuvers 
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TABLE 7 
(Continued) 



Stage 
Applied Navigation 
Air to Ground Weapons 

Tactics 

Air to Air Weapons 
Carrier Qualifications 



Task 



Cross Country 



Rockets Delivery 

Bombing 

Strafing 

Air combat maneuvers 
Gunnery 

Night field carrier landing practice 
Day field carrier landing practice 
Carrier qualifications 
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TABLE 8 

NORTH AMERICAN/LINK TA-4 FLIGHT SUBSTITUTION RECOMMENDATIONS 



STAGE 


SYLLABUS 
HOURS 


SIM A 
SUB HRS 


SIM A 
SUB % 


SIM B 
SUB HRS 


SIM B 
SUB % 


Familiarization 


11.2 


2.8 


25 


5.6 


50 


Basic Insts. 


8.4 


5.6 


67 


5.6 


67 


Inst. Nav 


36.1 


29.6 


82 


29.6 


82 


Formation 


12.6 


0.0 


0 


2.8 


22 


Night Flying 


8.5 


1.5 


18 


5.6 


67 


Oper Nav 


9.3 


0.0 


0 


4.0 


43 


Appl • Nav 


4.5 


3.0 


66 


3.0 


66 


Air/Grnd Wpns 


12.1 


0.0 


0 


5.5 


45 


Tactics 


9.9 


0.0 


0 


4.4 


44 


Air/Air Wpns 


4.0 


0.0 


0 


1.0 


25 


Car Qual 


12.4 


1.6 


13 


4.8 


39 




129.0 


44.1 


34% 


71.9 


56% 
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Table 9 



MEDIA LIFE CYCLE COST PER UTILIZATION HOUR 









COST PER 


UTILIZATION HOUR ($) 




MFHT A 


IITTTTTATTOM 


90^ UTILIZATION 


1 


Clflssroom 


J / . u 


CO "7 

53.7 


c. • 


iu tor 


•\n Q 


AO 1 


J* 


V* »• a 1 

v>£trrei 


1 Q 7 


1 "7 A 

17.0 




\jC 1 




1 A 1 
10 . I 


C 

J • 




AO A 


33 . 3 




CTM M/^ \7-{ e 
oirl - WO VIS* 


100 A 


Q Q O 


"7 


CTM It All \7-S r> 

oirl - A VIS. 


1 c "7 n 


12 o. o 


Q 

o. 


CTM IIDII \74 

oiW - VIS* 




O C 1 1 

231 . 1 


Q 

y » 


A/ u - Won- J? It. 


"70 A A 


630. I 


10. 


A/C + Inst. 


972.4 


869.2 


11. 


A/C Solo 


866.1 


762.7 


12. 


A/C Car* Lndg. 


5764.2 


5642.2 


13. 


SIM Car. Lndg. 


324.3 


259.0 


14. 


Two A/C + two Inst. 


1946.1 


1739.3 


15. 


Two A/C + one Inst. 


1816.4 


1614.5 


16. 


1.2 A/C + one Inst. 


1149.0 


1024.3 


17. 


1.7 A/C + one Inst. | 


1741.4 


1528.1 
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Table 10 



TA-4 TRAINING - MEDIA HOUR COMPARISON 









MEDIA 


HOURS PER TRAINEE 






MEDIA 


EXISTING 
TRAINING 
SYSTEM 


CONCEPTUAL 
TRAINING 
SYSTEM 


1. 


Classroom 


49.5 


14.0 


2. 


Tutor 


154.0 


154.0 


3. 


Carrel 




27.9 


4. 


CFT 






5.0 


5. 


CPT 




• 


17.5 


6. 


SIM 


- No. Vis. 


57.0 


53.1 


7. 


SIM 


- "A" Vis. 




4.0 


8. 


SIM 


- "B" Vis. 




31.9 


9. 


A/C 


- Non-Fit. 


3.9 


3,4 


10. 


A/C 


+ Inst. 


65.6 


35.6 


11. 


A/C 


Solo 


15 "i 


11 1 
1 1 • J 


12. 


A/C 


Car. Lndg. 


1.6 


1.6 


13. 


SIM 


Car Lndg. 




1.2 


14. 


Two 


A/C + two Inst. 


8.4 


7.3 


15. 


Two 


A/C + one Inst. 


12.7 


8.9 


16. 


1.2 


A/C + one Inst. 


6.6 


4.3 


17. 


1.7 


A/C + one Inst. 


4.0 


4.0 






TOTAL 


378.6 


385.0 
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Table 11 



TA-4 TRAINING - TRAINING STAGE HOUR COMPARISON 



TRAINING STAGE 



TRAINING STAGE HOURS PER TRAINEE 



EXISTING 
TRAINING 
SYSTEM 



CONCEPTUAL 
TRAINING 
SYSTEM 



1. Flight Support 

2. Familiarization 

3. Basic Instruments 

4. Instrument Navigation 

5. Formation 

6. Night Flying 

7. Operational Navigation 

8. Applied Navigation 

9. Air to Ground Weapons 

10. Tactics 

11. Air to Air Weapons 

12. Carrier Qualification 

TOTAL 



53.5 

24.6 

28.4 

102.4 

30.6 

18.4 

9.3 

10.5 

18.6 

27.9 

12.0 

42.4 
378.6 



43.9 

28.1 

28.2 

101.4 

34.1 

19.2 

14.4 

11.0 

20.5 

29.9 

12.0 

42.3 
385.0 
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Table 12 

TA~4 TRAINING - ALTERNATIVE COST COMPARISON 



STAGE 
OF 


YEARLY TRAINING COST ($ x 


1000 ) 


TRAINING 


EXISTING SYSTEM 


CONCEPTUAL SYSTEM 


POTENTIAL SAVINGS 


Flight Support 


1,617 


499 


1,118 


Familiarization 


4,082 


2,367 


1,715 


Basic Instruments 


3,902 


2,679 


1,223 


Instrument Navigation 


14.510 


9,479 


5,031 


Formation Flying 


8,971 


7,158 


1,813 


Night Flying 


4,087 


3,888 


199 


Operational Navigation 


3,637 


2,918 


719 


Applied Navigation 


1,722 


1,295 


427 


Air to Ground Weapons 


3,306 


2,720 


586 


Tactics 


7,592 


6,590 


1,002 


Air to Air Weapons 


2,927 


2,927 


000 


Carrier Qualification 


8,432 


7,782 


650 


TOTAL 


64.785 


. 50,302 


14,483 









NOTES: 
I. 



2. 



3. 



Yearly costs are computed on a life cycle basis as outlined in 
Section II. 

Costs shown above were developed for the purpose of testing 
economic analysis techniques and do not have the necessary 
accuracy for official estimates. 

Costs are based on 450 trainees per year completing each stage 
of training. 
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SECTION IV 



CONCLUSIONS AND FUTURE ACTIONS 

The feasibility of the Training Effectiveness and Cost Effectiveness 
Prediction (TECEP) Model has been demonstrated. Field testing of the 
Model, in conjunction with TAEG Task Analysis efforts^ are planned. 
Further development and refinement are warranted. Specifically: 

1. Task Description and Analysis 

FUTURE ACTION > An analysis should be made of the many existing 
task description and analysis methods to determine a format that would 
have the greatest utility for use with the TECEP Model. 

2. Media Selection Matrix 

CONCLUSION > The matrix, in its present state, demonstrates 
a useful approach to the task of media selection for specific learning 
tasks. 

The approach is based on identifying media that facilitate 
the use of specific learning guidelines (based upon scientifically 
derived principles of learning) for achieving specific types of 
learning tasks. 

In its present state of development, the matrix can be used to 
explore various media options, and propose a useful set of options. 
Further development will increase the usefulness of the matrix. It 
should be noted that the matrix is designed so that frequent revisions 
can be incorporated, to include new media as they are developed, and 
new learning guidelines as they are identified. 
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FUTURE ACTION * Further develop the matrix as follows: 

a. Accommodate additional media options as they are required 
for specific training systems. 

b. Add additional learning and implications for media guide- 
lines, as they are identified, 

c. Evaluate by having several psychologists, education and 
training specialists and military officers apply the matrix, and 
reclassify as necessary, the implications for media selection cells. 

d. Develop computer programs, as required, to allow the 
designer to interact with the matrix in an exploratory, iterative 
manner, until an acceptable set of options is identified. 

This improvement program should involve the routine application 
of the matrix to real media selection problems, in a continuing effort 
to develop a more practical technique. In the process, information 
should be acquired about the use of the Media Selection Matrix, such 
as its reliability (i.e.^ the consistency of media selection among 
users) and its practicality for application. 
3. Life-Cycle Cost Data 

CONCLUSION . The model identifies 19 cost factors and the 
computer ^rogram treats these factors to produce a media cost schedule 
for various utilization rates. This produces a comprehensive look at 
projected life-cycle costs. It. its present state of development, the 
model is a demonstration of an approach, and is a rudimentary cost 
projection system. Certain refinements, however, will make the model 
more precise. 



40 

52 



r 
r 

t 

f 

i 

{. 

{. 
f 

I. 

I 

t. 

r 

ERIC 



FUTURE ACTION , Improve the cost model by incorpora :ing multi- 
year funding, extending utilization in increments to 200%, and 
identifying required funds by year and by source, i.e., RDT&E , O&MN, 
PAMN, OPN, etc. Standardize the development of cost factors to Insure 
consistency in the estimates. 

4. Computer Programs 

CONCLUSIONS . ihe linear program is functioning and solves for 
the lowest cost mix of media capable of handling the projected curriculum 
and student flow. Presently, it is capable of solving problems with 
75 variables and 75 constraint equations, which appears to be adequate 
for most training systems. 

FUTURE ACTION . Update the computer programs as follows: 

a. Develop a linkage program to connect the cost utilization 
program to the linear program. 

b. Refine the programs to incorporate certain bookkeeping 
functions presently being done manually. 

c. Develop additional techniques to accomplish such tasks as 
manpower projections, and jcheduling/ time requirements. 

5. Economic Analysis 

CONCLUSION. The economic analysis of a proposed training system 
should systematically identify the benefits and costs associated with 
alternative training system options . 

FUTURE ACTION . Apply economic analysis techniques to TAEG 
projects in order to identify training system benefits and related costs. 
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6. Alternative Training Systems 

CONCLUSION > An assumption of the TECEP Model is that the 
alternative training systems proposed will all produce men trained to 
an equal level of proficiency. In other words, it is assumed that each 
alternative is designed to have equal training effectiveness. Then the 
least costly of several otherwise equal alternative training systems 
is selected by the linear program. 

FUTURE ACTION . The Model should be expanded to handle the 
following situations: 

a. For a given cost, select the training system alternative 
with the greatest training effectiveness. ^ 

b. Trade-off between training system alternatives having 
different costs and different training effectiveness values. 

7. Evaluation of the Utility of the Model 

FUTURE ACTION . The Model should be applied to the real-world 
situations of TAEG training analyses. The usefulness of the Model 
should be evaluated in terms of: 

a. Output of the Model as a basis for making decisions on 
training system configuration-^ 

b. Limitations, weaknesses, or assumptions inherent in the Model. 

c. Costs of using the Model. 
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MEDIA SELECTION MATRIX 
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MEDIA SELECTION MATRIX 



Purpose , By using the Media Selection Matrix, a training system 
designer can identify a set of useful training media suited to the 
characteristics of specific training tasks. It provides a guide for 
ranking media in order of pedagogical power to deal with specified 
training objectives. Final media selection should be based not only 
on pedagogical power, but also cost and other factors, as provided 
for in other parts of the TECEP Model. 
Directions for Use 

1. Classify tasks with one or more of the task categories listed 
in Table 1. Most real-world tasks are complex tasks which can only be 
described with two or more categories. 

2. Locate those pages of the Media Selection Matrix that represent 
the task categories of a specific training task. 

3. Tentatively rank each medium recording to the number of times 
"F" and "M" appears under a specific media heading. Count only the times 
"F" and "M" appear on the pages identified in step 2. 

NOTE: F « medium automatically facilitates the application of the 
learning guideline. 
M = medium enables an instructor or student to manually 
carry out the intent of the learning guideline. 

4. Review the tentative ranking in Step 3 to ensure that it is 
realistic in the specific instance under study, as the matrix was designed 
to represent typical tasks in each task category, but may not fully 
represent the specific task under study. 
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Assess in a precise manner, the 
performance of the trainee in terms 
of speed, accuracy and smoothness. 


Sliding criterion of ^success based 
upon stage of training. 


1 Capability to provide reinforcement | 


Logic for adapting training and 
reinforcement schedules. 


Speed and accuracy requirements 
dependent upon achieved skill. 


Individually determined schedule 
of review for maintenance of skill. 


• 

• 


LEARNING GUIDELINES 


Shaping - reinforcement should 
be contingent upon characteris- 
tics of trainee response, so 
that by a process of "successive 
approximations", the final 
desired proficiency. In terms 
of speed, accuracy and smooth- 
ness, is produced. 


Both rate and style of learning 
depend upon characteristics of 
the individual learner. 


• 


TASK 




Feedback 
(Contd) 


Personal 
Environ- 
ment 


• 

• 


POSITIONING AND SERIAL 
MOVEMENT (Continued) 

TASK CATEGORIES 
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IMPLICATIONS FOR MEDIA SELECTION 


Provide a standard set of perform- 
ance aids. 


Provision for trainee to be 
exercised in the use of "in-the- 
head" models. 


Provision for trainee vo use per- 
formance aids and/or "in-the-head" 
models to perceive required message 
content and to construct messages. 


Provision for extensive practice 
, (overlearning) when trainee will be 
required to perform under stress. 


Px*ovision for recording and 
evaluating student performance, 
to display KOR to trainee. 


Provision for some self-pacing 
within each stage or level of 
training. 


Provision for scheduling of 
advanced stages (different levels) 
and refresher training according tc 
individual's rate and level of 
Improvement. 


LEARNING GUIDELINES 


Performance Aids - Especially 
*ln early phase of training, use 
a performance aid or model, 
such as instructions, checklists 
or standard examples/formats to 
aid in perceiving need for and 
comoosine of messages. 


"In-the-head" mediators - In 
later stages of instruction relj 
on "in-the-head" instructions, 
models, etc. to aid in per- 
ceiving need for and composing 
reouired messai^es 


Make overt response - uompose 
message based on realistic 
event. ' 


Stress - When trainee will be 
required to perform under stress 
use overlearrdng of skill to 
minimize effects of competing 
resDon'Ses. 


Provide record of trainee's 
overt response to enable 
evaluation of trainee perform- 
ance. 


Rate, level and/ or style of 
learning depend upon character- 
istics of the individual 
learner. ' 


TASK 
ELEMENTS 


Stimulus 
ites: 


1 . 

OA * 


Feedback 


Personal 
Environ- 
ment 
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CALCULATION OF COST FACTORS 

1. The generalized set of cost factors for training media can be 
grouped into categories of acquisition and operation and maintenance. 
The acquisition cost relationship given in equation form is as follows: 

^ACQI ■ ^HD ^OD + ^TD ^FACA ^PSEA ^ ^GFE ^MTSA ^ 

CoTHA where: 

^ACQI " acquisition of a training medium within a 

training system. 
Chd = Cost of hardware, excluding contract modifications 

and logistic support items. 
^OD " contractor developed and installed 

modifications during the acquisition phase. 
Ctd " technical data and information to be 

supplied under the contract. 
Cj^g = Cost of all logistic support items to be provided under 

the terms of the contract, excluding parts and support 

equipment. 
^FACA ^ Facility preparation costs. 
CpsEA " parts and support equipment. 

Cqp£ = Total cost of Government Furnished Equipment supplied 

by the Government to be used as an integral part or in 

conjunction with the training medium. 
^^SA = Cost of Government management and technical services 

required to manage the project during the acquisition phase. 
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StHA ^ costs not previously defined. 

2. The relationship of cost categories for operation and maintenance 
is as follows: 

^OMNI ^ ^PSEO ^PRS + + CoMTG + CpAOV + ^^SO + ^OTHO where: 
^OMNI ^ Annual operation and maintenance cost of the training 
medium. 

CpggQ = Cost of replacement and replenishment of spares, repair 

parts and support equipment during the operational phase. 

^PRS ^ Direct and indirect personnel costs required for 
instruction, operation and support, excluding the 
trainee costs. 

Cpj^ = Cost of field configuration and non-configuration 

modifications, excluding the cost of Government personnel. 

Crsxrrn = Cost of training and retraining operators and maintenance 
personnel required to support the training medium. 

^FAOV ^ Variable facility costs associated with the training 
medium such as electrical power or fuel. 

^FAOF " Fixed facility costs such as janitorial services. 

^MTSO " Cost of Government management and technical services 
required during the operational phase. 

CqtHO " Operation and maintenance costs associated with the 

training medium, but not defined elsewhere. Cost for 
re- installation, storage, documentation revision, and 
travel would be included in this category. 
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3. Cost factors for training devices are developed through cost 
estimating techniques, most often the element estimate method. Cost 
factors for operational equipment are projected utilizing existing 
data such as found in 0PNAV-90P-02, Navy Program Factors. The cost 
factors are entered into the cost model in the form shown in Table 6. 
The treatment of the factors is shown in Figures 3 and 4. 

4. Three of the cost factors: C^g^Q, Cpj^g, and Cp^gv functions 
of utilization time. The cost model considers an estimated cost for 
each factor at full (100%) utilization and linearizes the factor for 
all other values. Linearizing in this manner does introduce an error, 
but for estimating purposes at this time, the error is tolerable. 

a. C • the cost of spares, repair parts and support equipment 

PSEO 

in the operational phase, is also a function of the maintenance concept 
and the reliability of the system. Since operation of the system is 
assumed to be in the constant failure rate region of the life cycle, 
the linear approximation is valid. 

b. CoDo the cost of personnel to operate and maintain training 
media, varies with utilization in a "stairstep" manner. Increased 
utilization requires changes in manning levels that are determined 
through a staffing criteria analysis. Linearization of costs will 
introduce some error, but of little significance. 

c. Cp^oV» variable portion of facilities costs, is a linear 
function of utilization, assuming that utilization is a ratio of 
"power-on" time. This factor, as applied to electrical power for 
training devices, is analogous to the fuel consumption factor as 
applied to operational training aircraft. 
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d. Special Considerations 

(1) Care must be exercised In the development of cost factors 
by making valid assumptions In the estimating process. The accuracy of 
the cost model output Is determined by the estimate precision of the 
Individual cost factors. The prediction of cost factor values for 
training devices is made by specialists in each of their fields 
representing acquisition and logistic support disciplines. Sufficient 
expertise Is available at the Naval Training Equipment Center to 
estimate cost factor values on training media to a relatively high 
degree of confidence. However, when alternative training system options 
Include operational equipment, such as training aircraft, estimating 
must be based upon cost data developed outside NAVTRAEQUIPCEN . The 
cost data for operational equipment consists of composite factors with- 
out breakdown or detailed rationale. Navy Program Factors, promulgated 
by CNO (OP-90), is the usual source of system operation costs. It Is 
imperative that the selection of operational cost factors for predicting 
future costs be done in a judicious and consistent manner. 

(2) The life cycle cost model, in Its present form, does not 
treat costs by required funding categories. Funds are not specifically 
Identified as O&M.N, OPN, PAMN, etc. Rather, the composite of all 
funding required for the life cycle of training media is considered 

in the model. 

(3) There exists today within the Naval training device 
community a variation of operating procedures that may not be predictable 
during the concept formulation phase. For Instance, some activities 
require that training devices be activated twenty-four hours per day 
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even if the actual training utilization is eight hours or less. The 
differential between utilization time and "power-on" time is signifi- 
cant in projecting variable operation and maintenance costs. Unfortun- 
ately, it is not possible to predict this type of occurrence and, 
consequently, the actual life cycle costs will differ from the estimated 
values • 

(4) In this report, ths end-of-year convention was used which 
assumes that cash flows occurring throughout a year were concentrated 
at the year end. This convention is not completely harmonious with 
Secretary of the\Navy Instruction 7000.14, wherein the discounting 
tables presented reflect the continuous compounding of interest. Since 
neither convention is a completely accurate reflection of the "real 
world" situation, the end-of-year convention was adopted because of the 
convenience of being able to use standard interest formulas and tables 
and the greater acceptance by most people of periodic compounding as 
opposed to continuous compounding. In most cases, the outcome decisions 
of the economic analysis will be the same regardless of the convention 

used. The objective of the analysis is to^ compare alternative training 

\ 

systems where "relative" as opposed to "absolute" costs are of prime 

\ 

concern. ^\ 
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APPENDIX C 



LINEAR PROGRAM SAMPLE OUTPUT FOR TA-4 AIRCRAFT TRAINING SYSTEM 
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DESCRIPTION OF LINEAR PROGRAM SAMPLE OUTPUT 



General 

The linear program sample output shown in this Appendix provides 
optimization information for the tactics stage of TA-4 training. The 
constraint equations C(l), C(2), and C(3) provide allowable media 
substitution ratios and time constraints. The objective function, which 
is to be minimized in this example, introduces the dimension of media 
cost per utilization hour. The computer uses the simplex method of 
solution to provide the minimum objective function within the above 
constraints and provides information on the number of iterations required 
for optimization. The time in each medium is given for the minimum cost 
case and the delta objective function provides information on costs 
associated with changes to the optimum mix. 
Computer Input 

The computer input information consists of constraint equations and 
media cost data per utilization hour for a given level of utilization. 
The three constraint equations, represented as C(l), C(2), and C(3) 
are shown below: 

C(l) > 7.9 

C(2) Xj^ + 0.5X2 - ^'^ 

C(3) X^ t 18.0 

represents hours in medium 1 (aircraft + instructor) 
X2 represents hours in medium 2 (simulator with wide angle visual) 
X3 represents hours in medium 3 (tutor) 
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The constraint equations are used in conjunction with media cost 
information. For this example, the cost per utilization hour of each 
media considered is: 

Medium 1 (aircraft + instructor) = $972.40 
Medium 2 (simulator with wide angla visual) = $314.30 
Medium 3 (tutor) = $50.90 
Computer Output 

Using the simplex method of solution, the computer provides information 
on the number of hours assigned to each medium for the minimum cost mix. 
It also records the number of iterations required for optimal solution. 
In this example, four iterations were required for optimal solution and 
the cost (minimum) is given as the objective function value ($9855.35). 
This value is the summation of the costs associated with each medium 
used in the stage of training and is shown below: 
Medium 1 7.9 hours x $972.40 = $7681.95 
Medium 2 4.0 hours x $314.30 = $1257.20 
Medium 3 18.0 hours x $50.90 = $ 916.20 

Total Cost = $9855.35 
In addition to optimal mix (minimum cost) information, a delta 
objective function is provided which shows the allowable variation of 
each constraint limit within the solution range. The cost per hour to 
be subtracted from or added to the objective function value is also 
given. As an example, if the C(3) constraint equation limit is reduced 
two units, whtch-is in the allowable range of 18 unit decrease to an 
unlimited increase, the equation would become: 
X3 t 16.0 
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This would reduce total cost by; 

2 hours X $50.90 = $101.80 
The resulting objective function would become: 

$9855.35 - $101.80 = $9753.55 
Each stage of training was analyzed in the above manner in order to 
arrive at total system optimization. 
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APPENDIX D 



LIFE CYCLE COSTS PER UTILIZATION HOUR FOR 17 MEDIA 
(COST/UTILIZATION PROGRAM OUTPUT) 
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